An Investigation of Techniques that Aim to Improve the Quality of Labels provided by the Crowd
نویسندگان
چکیده
The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we’ve applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.
منابع مشابه
Digital Art and Crowd Creation in Iran (Case Study: Tehran Annual Digital Art Exhibition)
This paper aims to show the status of digital art in Iran and explain how the meaning of an artist has transformed in the digital age. The primary assumption of this paper is that the experience of digital art has again revived the collective experience in creating arts. Although, interactivity is considered to be the most important quality of digital art, their collective, collaborative and pr...
متن کاملSemiautomatic Image Retrieval Using the High Level Semantic Labels
Content-based image retrieval and text-based image retrieval are two fundamental approaches in the field of image retrieval. The challenges related to each of these approaches, guide the researchers to use combining approaches and semi-automatic retrieval using the user interaction in the retrieval cycle. Hence, in this paper, an image retrieval system is introduced that provided two kind of qu...
متن کاملInvestigation of Ground Waters Quality Using Multivariate Statistical Techniques (Case Study: Maragheh-Bonab Plain, East Azerbaijan Province)
Investigation and analysis of groundwater quality to monitor contamination and identify the most important pollutants and pollution points is one of the research fields. The objective of this research was to plan to improve groundwater quality on various spatial and temporal scales. Groundwater information of Maragheh-Bonab plain was collected from 26 wells in 10 years (2001-2011) with 454 samp...
متن کاملExperimental Investigation and Optimizing Geometrical Characteristics and Surface Quality in Drilling of AISI H13 Steel
The aim of this paper is to investigate and optimize surface quality and geometrical characteristics in drilling process of AISI H13 steel, because they are critical items for precision manufacturing. After conducting the experiments, two regression models are developed to extensively evaluate the effect of drilling parameters on process outputs. After that, evolutionary multi-objective optimiz...
متن کاملQuality Control of Crowd Labeling through Expert Evaluation
We propose a general scheme for quality-controlled labeling of large-scale data using multiple labels from the crowd and a “few” ground truth labels from an expert of the field. Expert-labeled instances are used to assign weights to the expertise of each crowd labeler and to the difficulty of each instance. Ground truth labels for all instances are then approximated through those weights along ...
متن کامل